Technology Focus: Data Acquisition 



® Portable H andheld 0 ptical Window Inspection Device 

This device allows field measurement of defects such as commercial aircraft windows. 

John F. Kennedy Space Center, Florida 


The Portable Handheld Optical Win- 
dow I nspection Device (PH OWI D) is a 
measurement system for imaging small 
defects (scratches, pits, micrometeor im- 
pacts, and the like) in the field. De- 
signed primarily for window inspection, 
PHOWID attaches to a smooth surface 
with suction cups, and raster scans a 
small area with an optical pen in order 
to provide a three-dimensional image of 
the defect. PHOWID consists of a graph- 
ical user interface, motor control subsys- 
tem, scanning head, and interface elec- 
tronics, as well as an integrated camera 
and user display that allows a user to lo- 
cate minute defects before scanning. 
Noise levels are on the order of 60 nin. 
(1.5 nm). 

PHOWID allows field measurement of 
defects that are usually done in the lab. It 
issmall, light, and attaches directly to the 
test article in any orientation up to verti- 
cal. An operator can scan a defect and get 
useful engineering data in a matter of 
minutes. There is no need to make a 
mold impression for later lab analysis. 


The PHOWID system components 
consist of a scanning head, motor control 
board, graphical user interface, and sup- 
porting electronics, and weighs approxi- 
mately 5 pounds (2.3 kg). The scanning 
head consists of an x-y positioner, optical 
distance sensor, carrier plate, and vac- 
uum supplied suction cups. The head has 
an integrated camera and LCD (liquid- 
crystal-display) screen that allows a user 
to easily position it above the defect. Vac- 
uum is supplied to suction cups through 
a dual circuit system, which includes 
check valves to hold the head against the 
window or other smooth surface up to 
90° inclination in the event that the vac- 
uum source is lost. The graphical user in- 
terface (GUI ) di splays the surface image 
and allows the user to describe an area of 
interest to be scanned at various speeds 
and resolutions. The GUI displays the 
scanning progress in real time. Once a 
scan is completed, software provides the 
automated measurement capability to de- 
termine defect length, width, and depth 
and will store this information in a file. 


TheGUI also communicateswith the mo- 
tion control electronics. These electron- 
ics control the x-y positioning motors 
that move the optical sensor in the sensor 
head. These electronics also combine the 
depth and position data in real time and 
stream the data to the GUI. The associ- 
ated electronics box containsthe vacuum 
pumps, optical -sensor conditioning elec- 
tronics, and power supplies. 

Functionally, the user placesPHOWID 
over the defect using the integrated cam- 
era. The user selects the desired area, 
resolution, and scan speed at the laptop 
GUI and initiates scanning. PHOWID 
has a depth range of 0.01 in. (0.25 mm) . 
It has a noise floor better than 60 nin. 
(1.5 (im). Usable scan area is on the 
order of an inch square. Smallest resolu- 
tion ofthescan in the x-y direction ison 
the order of 300 nin. (7.6 urn). 

This work was done by Curtis I hlefdd and 
Adam Dokos of Kennedy Space Center and 
Bradiey Burns of ASRC Aerospace Corpora- 
tion. Further information is contained in a 
TSP (see page 1). KSC-13218 


@ Salience Assignment for Multiple-Instance Data and Its 
Application to Crop Yield Prediction 


Automated mapping of crops saves on survey time and improves map accuracy. 

NASA's Jet Propulsion Laboratory, Pasadena, California 


An algorithm was developed to gen- 
erate crop yield predictions from or- 
bital remote sensing observations, by 
analyzing thousands of pixels per 
county and the associated historical 
crop yield data for those counties. The 
algorithm determines which pixels con- 
tain which crop. Since each known 
yield value is associated with thousands 
of individual pixels, this is a "multiple 
instance" learning problem. 

Because individual crop growth is re- 
lated to the resulting yield, this relation- 
ship has been leveraged to identify pixels 
that are individually related to corn, 
wheat, cotton, and soybean yield. Those 


that have the strongest relationship to a 
given crop's yield values are most likely to 
contain fields with that crop. Remote 
sensing time series data (a new observa- 
tion every 8 days) was examined for each 
pixel, which contains information for that 
pixel'sgrowth curve, peak greenness, and 
other relevant features. 

An alternating-projection (AP) tech- 
nique was used to first estimate the 
"salience" of each pixel, with respect to 
the given target (crop yield), and then 
those estimates were used to build a re- 
gression model that relates input data 
(remote sensing observations) to the 
target. This is achieved by constructing 


an exemplar for each crop in each 
county that is a weighted average of all 
the pixels within the county; the pixels 
are weighted according to the salience 
values. The new regression model esti- 
mate then informs the next estimate of 
the salience values. By iterating between 
these two steps, thealgorithm converges 
to a stable estimate of both the salience 
of each pixel and the regression model. 
The salience values indicate which pix- 
el s are most relevant to each crop under 
consideration. 

This approach produces better esti- 
mates than an existing "primary in- 
stance" (PI) approach does. The PI ap- 
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proach assumes that each county con- 
tains a single canonical pixel for each 
crop (corn, cotton, soybean, etc.) and 
that the rest of the pixels in that county 
are noisy observations of the true one. 

Thiswork could ultimately provide au- 
tomated mapping of crops that are 


being grown, which could save agencies 
such as the U.S. Department of Agri- 
culture a significant amount of money 
that is currently devoted to surveying 
fields to produce summaries of how 
much of each crop is being grown. Reli- 
able early estimates of the likely volume 


of production can significantly affect 
crop prices throughout the season. 

T his work was done by K iri L . Wagstaff 
of Caltech andTerran Lane of the Univer- 
sity of New M exico for NASA's Jet Propul- 
sion Laboratory. For more information, 
contact iaoffice@jpl.nasa.gov. NPO-45177 


@ Speech Acquisition and Automatic Speech Recognition for 
Integrated Spacesuit Audio Systems 

This interface also has applications in mobile phones, in-car devices, and home electronics and 
appliances. 

John H . Glenn Research Center, Cle/eland, Ohio 


A voice-command human-machine 
interface system has been developed 
for spacesuit extravehicular activity 
(EVA) missions. A multichannel 
acoustic signal processing method has 
been created for distant speech acquisi- 
tion in noisy and reverberant environ- 
ments. This technology reduces noise 
by exploiting differences in the statisti- 
cal nature of signal (i.e., speech) and 
noise that exists in the spatial and tem- 
poral domains. As a result, the auto- 
matic speech recognition (ASR) accu- 
racy can be improved to the level at 
which crewmembers would find the 
speech interface useful. The developed 
speech human/ machine interface will 
enable both crewmember usability and 
operational efficiency. It can enjoy a 
fast rate of data/ text entry, small overall 
size, and can be lightweight. In addi- 


tion, thisdesign will free the handsand 
eyes of a suited crewmember. 

Thesystem components and stepsin- 
clude beam forming/ multi-channel 
noise reduction, single-channel noise 
reduction, speech feature extraction, 
feature transformation and normaliza- 
tion, feature compression, model adap- 
tion, ASR HMM (Hidden Markov 
Model) training, and ASR decoding. A 
state-of-the-art phoneme recognizer 
can obtain an accuracy rate of 65 per- 
cent when the training and testing data 
are free of noise. When it is used in 
spacesuits, the rate drops to about 33 
percent. With the developed micro- 
phone array speech-processing tech- 
nologies, the performance is improved 
and the phoneme recognition accuracy 
rate rises to 44 percent. The recognizer 
can be further improved by combining 


the microphone array and H M M model 
adaptation techniques and using 
speech samples collected from inside 
spacesuits. In addition, arithmetic com- 
plexity models for the major HMM- 
based ASR components were devel- 
oped. They can help real-time ASR 
system designers select proper tasks 
when in the face of constraints in com- 
putational resources. 

This work was done by Yiteng (Arden) 
Huang, Jingdong Chen, and Shaoyan 
(Sharyl) Chen ofWEVOiCE, Inc. for Glenn 
Research Center. Further information is con- 
tained in a TSP (seepagel). 

inquiries concerning rights for thecommer- 
cial useof this invention should beaddressed 
to NASA Glenn Research Center, Innovative 
Partnerships Office, Attn: Steve Fedor, Mail 
Stop 4-8, 21000 Brookpark Road, Cleve- 
land, Ohio 44135. Refer to LEW-18534-1. 


@ Predicting Long-Range T raversability From Short-Range Stereo- 
Derived Geometry 

Learning-based software improves obstacle avoidance by robotic ground vehicles. 

NASA's Jet Propulsion Laboratory, Pasadena, California 


Based only on its appearance in im- 
agery, this program uses close-range 3D 
terrain analysis to produce training data 
sufficient to estimate the traversability of 
terrain beyond 3D sensing range. This 
approach is called learning from stereo 
(LFS). In effect, the software transfers 
knowledge from middle distances, where 
3D geometry provides training cues, into 
the far field where only appearance is 
available. This is a viable approach be- 
cause the same obstacle classes, and 
sometimes the same obstacles, are typi- 


cally present in the mid-field and thefar- 
field. Learning thus extends the effective 
look-ahead distance of the sensors. 

The baseline navigation software ar- 
chitecture in both the LAGR (Learning 
Applied to Ground Robotics) and MTP 
(Mars Technology Program) programs 
operates so that stereo image pairs are 
processed into range imagery, which is 
then converted to local elevation maps 
on a ground plane grid with ceils 
roughly 20-cm square covering 5 to 10 m 
in front of the vehicle, depending on 


camera height and resolution. The 
image and the map are the two basic co- 
ordinate systems used, but only pixels 
with nonzero stereo disparity can be 
placed into the map. Geometry-based 
traversability analysis heuristics are used 
to produce local, grid-based, 'traversabi I- 
ity-cost' maps over the local map area, 
with a real number representing travers- 
ability in each map cell. The local eleva- 
tion and cost mapsare accumulated in a 
global map as the robot drives. Path 
planning algorithms for local obstacle 
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